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Abstract 

Earth medium effects in the three-neutrino oscillations of atmospheric neutrinos 
are observable under appropriate conditions. This paper generalizes the study of the 
medium effects and the possibility of their observation in the atmospheric neutrino 
oscillations from the case of neutrinos traversing only the Earth mantle, where the 
density is essentially constant, to the case of atmospheric neutrinos crossing also the 
Earth core. In the latter case new resonance-like effects become apparent. We calcu- 
late the CPT-odd asymmetry for the survival probability of muon neutrinos and the 
observable muon-charge asymmetry, taking into account the different atmospheric 
neutrino fluxes, and show the dependence of these asymmetries on the sign of Am^j^ 
and on the magnitude of the mixing angle ^13. A magnetized detector with a suf- 
ficiently good neutrino momentum resolution is required for the observation of the 
muon-charge asymmetry generated by the Earth mantle-core effect. 
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Recently, it was shown [|T| that medium effects in the three-neutrino oscillations of 
atmospheric neutrinos crossing the Earth mantle become observable under appropriate 
conditions. At the fundamental level, their study by means of a magnetized detector, 
able to provide muon charge discrimination and energy resolution, would allow to mea- 
sure the sign of the neutrino mass-squared difference, Amg^^, responsible for the dominant 
z/^ ^ Vj. and z/^ ^ Vr oscillations of the atmospheric and v^. Such a study will also 
allow to explore the lepton mixing matrix element \Uez\ = sin ^13, which "connects" the 
solar and atmospheric neutrino oscillations. In the limit of Aml-^^L / {2E) << 1, valid for 
atmospheric neutrino oscillation baselines, Amgi > being the neutrino mass-squared 
difference responsible for the oscillations of solar neutrinos, L the baseline and E the neu- 
trino energy, the main conclusions are based on the following: i) the medium effects, which 
discriminate between neutrino and antineutrino propagation, determine the sign of the 
atmospheric Amg^ 0; ii) for sin ^13 = S13 = electron neutrinos decouple from the oscil- 
lations of the atmospheric neutrinos in matter, whereas they mix with the third (heaviest) 
mass eigenstate neutrino and take part in the atmospheric neutrino oscillations if S13 7^ 0, 
although their mixing with the first (lightest) mass eigenstate neutrino still vanishes; iii) 
non-resonant medium effects are already apparent in the sub-dominant channels 
and Ue —>■ i^^, for baselines L ~ 3000 km, in both the mixing and oscillation phase shift (see 
also 0, 1^); iv) in order for the medium effects in the muon neutrino survival probability 
to be observable, the resonant MSW effect in the t'e(/i) ^n{e) and Ve(^i) — > ^'/^(e) transitions 
must be operational, which requires baselines larger than L ~ 7000 km, the optimal base- 
line being a function of the value of sin6'i3; v) taking into account the initial atmospheric 
z/^, u^, and v^, Vf. fluxes and the relevant charged current neutrino- nucleon deep inelastic 
scattering cross-sections, it was shown that the matter-induced CPT-odd and CP-odd 
1^, ^, 0] asymmetries are observable. 

The indicated results were obtained for matter of constant density. Although there is 
a wide range of Nadir angles (from 33.17° to 90°), corresponding to atmospheric neutrinos 
crossing the Earth mantle, and to which the results of the study [||] apply, it is of interest 
to extend the study to the case in which atmospheric neutrinos cross the Earth core. This 
is the aim of the present paper. In our analysis we use the two-layer model of the Earth 
density distribution (see, e.g., [§). Detailed numerical studies (see also P, [10|, pJ]] ) 



showed that, for the calculation of the probabilities of interest, the two-layer model of the 
Earth density distribution provides a very good (in many cases excellent) approximation to 
the more complicated density distributions predicted by the existing models of the Earth 
According to the existing Earth models, neutrinos which traverse the Earth along a 



trajectory with a Nadir angle 6'„ < 33.17° will cross the Earth core. For such trajectories, 
the distances of propagation in the mantle and in the core, and L^, are not independent 
and are given by 



L, = 2R -sin^ On 



, sin2ft„<f (1) 
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where R 

m 



6371 km and Tc = 3480 km are the radii of the Earth and of the Earth core 
respectively. The total baseline is L = 2 + Lc, with neutrinos propagating in 



three regions of different constant density, mantle-core-mantle, the densities of the first 
and third regions being identical. The probabilities of atmospheric neutrino oscillations 
we will consider are symmetric with respect to the interchange i) of the initial and final 
points of the neutrino trajectories, located close to, or on, the Earth surface, and ii) of the 
initial and final flavour neutrinos. This implies the vanishing of T-odd asymmetries ||13| . 
The effective neutrino potential differences in the Earth mantle and in the core, which 

Ue oscillations of the atmospheric neutrinos of 



and Uii 



in the case of the Ue - 
interest have the well-known form [jl4|, O, ff| 



m(c) 



V2Gt 



(2) 



-^m(c) being the electron number density in the mantle (core) 



lead to interesting new 

effects of resonance-like enhancement of the z/g — > u^^r and z/^ —>■ v^, transitions beyond 
the MSW resonance of the mixing [|l^, |15|, |T^. These effects have been well discussed in 
In the limit A21 



19, 20 



Am^^ L/(2 E) 



0, the traceless 2x2 matrix describing the 



effective Hamiltonian of the two neutrino states whose evolutions are coupled 
2i 
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,see, e.g. 



e and z/'. 



v' = sin 6123 + Vt cos 6123 , (3) 

where ^23 is the mixing angle, which in the limit of 6*13 = controls the atmospheric 
i^ii — i^T and — i> Vr oscillations, leads to an 2 x 2 unitary evolution matrix of the form 
(see, e.g. 



23 



where Um{c) is the evolution operator in the Earth mantle (core) 



Here 



Um(c) = e *('^^'"w)<^™w = cos0^(c) - iiafimic)) sin0^(c). 



(4) 



(5) 



-AE, 



m(c) J-'m{c) 



(6) 



is the difference between the phases of the two neutrino energy eigenstates, acquired after 
neutrinos have crossed the Earth mantle (core), AEm{c) being the difference between the 
energies of the two states in the mantle (core). 



m(c) 



2E \ 



cos 29 



2EVr 
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m{c) 



Amii 



+ sin^ 29 



13) 



(7) 



-'^In the two-layer model of the Earth density distribution, and are [g, the mean electron 
number densities along the neutrino trajectory in the mantle and in the core, respectively. For the Earth 
center-crossing neutrinos, for instance, one has [|l2|, |l^: = 2.2 cm^'^ Na and = 5.4 cm^'^ Na, 
where Na is the Avogadro number. 
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and hm(c) is a real unit vector EM, 



n^(,) = (sin2^™W,0,-cos2^™(^)) , n^(,) = 1, (8) 

where 9^^^^ is the mixing angle in the mantle (core), which in the limit of zero neutrino 
effective potential difference, Vm{c) — ^ 0, coincides with 6*13, 



cos 



{{AmlJ2E) cos 2^13- K.{c)). 



(9) 



Using eqs. ®-(||), it is not difficult to express the evolution operator of interest U in terms 
of the quantities characterizing the evolution of the neutrino states in the mantle and in 
the core (see, e.g., [|^, |23[|): 



U = e 



— j((T n) 



COS0 — lia n) smi 



(10) 



where 



COS0 = cos(20m) cos 0c — cos(26''^ — 26'™') sin(20m) sin( 



'111 



nsin0 = fira [sin(20m) cos 0c — {fim ■ 5t-c)(1 — cos(20m)) sin 0c] + iT-cSin^c- (12) 

The two-neutrino oscillation probability P(z/e v') = P{u' — i/g) = P2, is determined by 
the elements of the evolution matrix U, P2 = If/j/vJ^? and can be written in the form JH?] : 

P2 = [rii sin 0)^ + {n2 sin 0)^ = 1 — cos^ — {n^ sin 0)^ , (13) 
where cos is given by eq. (|Tl|) and sin is determined by eq. (|l^) : 



ns sin = cos 2^"" [sin 0c cos 20^ cos(2e"-2^™)+cos 0c sin 20„]-sin 0c sin 2^"" sin(2^"-2^™). 

(14) 

The z/g ^ t'^ and Vj. transition probabilities and the z/g survival probability of 

interest are related to the probabihty P2 (see, e.g., [^, ^): 



P{Ue^y^)=sl^P2 , P(z/e ^ Z/,) = 4 P2 , P(z/c ^ Z/g) = 1 - P2 • (15) 

where C23 = cos 6*23 and S23 = sin 6^23. We also have P(z^e — * z/^) = P{i'^ z/g). The proba- 
bilities of oscillations of antineutrinos can be obtained from the corresponding probabilities 
of oscillations of neutrinos by replacing Vm(c) by — Kn(c) in the expressions for the energy 
differences A£^m{c) and the mixing angles ^'"('^^ in the mantle and in the core, eqs. (|^ and 
(I)- 

The conditions for the absolute (P2 = 1) maxima of the z/g — z/^, z/^ — z/g and z/g — ^ z/^ 
transition probabilities follow from the expression (|T3p for the probability P2 | |19| |: 
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cos(/) = , sine/) = 0, 



(16) 



with COS0 and sin0 given by eqs. (|Il|) and ([T^). 

In the case of constant density, i.e., Vc = Vm and, correspondingly, AiJ^ = Ai^c, 
Qc _ Qm^ _ 0^ _|_ = AEm{Lc + 2Lm)/2, the two conditions (|T6|) correspond to 
the simuhaneous requirement of both a maximum in the oscillating factor sin^ 0, 

namely, cos0 = 0, and MSW-resonance in the amplitude of the oscillations sin^2^'", 
n3sin0 = cos 26'™ sin = ±cos2^™' = 0. There is a crucial difference between the case 
of constant density and the one we are interested in. When neutrinos cross the mantle, 
the core and the mantle again, the oscillation phase is no longer linear in the baseline 
L. Instead, it depends non-trivially on the distances traveled in each layer, and L^. 
Similarly, the condition ns sin = is a global one, without direct correspondence with 
the MSW-resonance condition in a given layer. 

In terms of the oscillation phases in each layer, 0m and 0c, the solution of the conditions 
(P^) for the absolute maxima of P2 can be written as 



l-tan^0m , l-^jrimn,) 

tan0e = — , tan 0„ = ^ , ^ I . -77 — rr^ • (17) 

2 [Um ric) tan 0^ 1 + [n^ n^) - 2 {n^ n^y 

They can be expressed in terms of the mixing angles in matter in each of the two layers 
(Earth mantle and core) p!9|: 



tan 0m — iy' ^os (le^'^2e'') ' 
tan0.. = ±-, ^m=_ = , 



where the signs in ([TsD are correlated. Under the assumptions of cos 2 ^13 > and 
Am|i > 0, together with the fact that Vm < Vc, the domain in which ( p^Bf ) can be ful- 



filled is 



cos 2^^ < 

domain A : ^ (19) 
cos (4^"" - 26^) > 

The absolute maximum reachable in the domain (|19D represents a new feature of the 
^ijl(t) and — > Ve transition probabilities beyond the well-known MSW resonance in 
the mixing. The new enhancement effect disappears in the limit of constant density, when 
QC _ Qm^ because the domain "collapses" just to the resonance condition for the mixing 
in matter. It is not guaranteed a priori that, for a given Nadir angle, corresponding to 
neutrino trajectories crossing the Earth core region, both conditions (0) can be satisfied 
simultaneously, since the radii of the Earth and that of the Earth core and, correspondingly, 
Lm. and L^, and the electron number densities in the Earth mantle and core, N^^^^, are 



fixed. It was shown in |TP| that solution A is realized for the z/g t'^(r) and z/^ 
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transitions of the Earth core-crossing atmospheric neutrinos and a rather complete set 
of values of ^m\i/E and sin^2^i3, for which both conditions in ([18|) hold for neutrino 
trajectories with Nadir angle On = 0°; 13°; 23"; 30°, was found. We will present results for 
the matter-induced CP-odd and CPT-odd asymmetries as a function of the Nadir angle 
(see below). 

Besides the possible absolute maxima described by ([T8|), with P2 = 1, there can be 
alternative (local) maxima (in the variables (pm and 0c) corresponding to ^ 



i) 



ii) 



iii) 



cos = , sin0(; = O, (20) 

in the "domain" B: cos 2^™ = 0, 

with probability P2 = sin^ 29m = 1; 

sin 0m = , COS0C = 0, (21) 

in the domain C: cos 26'^ > 0, 

with probability P2 = sin^ 29'^. 

COS0m = , COS0c = O, (22) 

in the domain D: cos (4^"" - 29^) < 0, 

with probability Pa = sin^ (4^"^ - 2^); 



The maxima of P2 described by (^2]), known as the NOLR solution p], like the absolute 
maxima of solution A, eq. (|TB|), are due to a constructive interference between the probabil- 
ity amplitudes of the neutrino transitions in the two different layers - the Earth mantle and 
the core Solution A and solution D coincide on the border line cos (46'"* — 29'^) = 0, 
which is common to both regions A and D. The building up of the indicated constructive 
interference is illustrated in Fig. |I|, where we show Pli^e ^ti) = as a function 

of the distance traveled by the neutrinos in the Earth in two different cases, associated 



with solutions A and D. In both cases, we have used 12511 ^''^ii = 3.2 ■ 10 eV and 



sin^ ^23 = 0.5. The two panels correspond to solution A for 9n = 0° at sin^ 2^13 = 0.15 and 
E = 6.6 GeV, and to absolute maximum of type B (i.e., an absolute maximum at which 
cos (4^™ - 29^) = 0) for 9^ = 23° at sin^ 2^13 = 0.05 and E = 5.0 GeV M . 



Solution B (C) defined by (pOD ((|2lD), describes maximum conversion in the mantle 
(core), with no transitions taking place in the core (mantle). The region B is a line (in 
the E — sin^ 26'i3 plane) on which the MSW resonance condition is satisfied in the 



Earth mantle; it lies entirely in region A [O]. On the border line of region C, cos29'^ = 0, 
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Figure 1: Constructive interference in the Earth in the channel z/g — * z/^: P(z/e ~^ v^i) as 
function of the distance (in km) traveled by the neutrinos in the Earth, for Am|]^ = 3.2-10"'^ 
eV^ and sin^ 62^ = 0.5. The upper panel corresponds to solution A for 9n = 0° at E 6.6 
GeV and sin^ 29is — 0.15; the lower panel corresponds to solution B for 9n = 23° at E 5.0 
GeV and sm'^2e^', ~ 0.05. 



which is also a border line of region A and on which solutions C and A coincide, the MSW 
resonance condition in the Earth core is fulfilled. 

As emphasized in [0], in a situation in which the dominant oscillation channel is z/^ — u^, 
the only method to observe the medium effects in the survival probability (and thus, 
reach sensitivity to the sign of Amg^ and the value of 613) is to operate under conditions in 
which the resonance phenomenon in the transitions z/^ —>■ Ve are observable. For constant 
density in the mantle of the Earth, this requirement implies a baseline L > 7000 km, i. e., 
a Nadir angle 6^ < 56.68°. The constant density approximation can only be maintained 
for 6n > 33.17°. The question is whether for 6n < 33.17°, one finds, for the values of 
Am|^ from the atmospheric neutrino oscillation region and of ^13 from the region allowed 
by the CHOOZ data, solutions to the absolute maximum conditions ([T8| ) in the energy 
range relevant for the atmospheric neutrinos. The phenomenon of constructive interference 
between the neutrino transition amplitudes in the Earth mantle and in the core was shown 



19| to take place practically for all Nadir angles, associated with baselines crossing the 



Earth core, and for energies of atmospheric neutrinos, which for Amg^ = 3.2 x 10 ^ eV^ lie 
in the multi-GeV region, E={3 — 9) GeV. In Figs. ^ we show the probability P(z/e — > z/^) 
as a function of the neutrino energy E for Am|i = 3.2 ■ 10-^ eV^, sin^ 2^23 = 0.5 and 
sin^ 2^13 = 0.10 (solid line), 0.05 (dotted line). The four panels correspond to neutrino 
trajectories with Nadir angles 6n = 0°, 13°, 23° and 30°, respectively. 

The two dominating maxima in the probability P(z/e z/^), located in the energy 
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Figure 2: The probability Pii^e ~^ ^ii) for neutrinos crossing the Earth core, as a function 
of the neutrino energy E (in GeV), for Amg^ = 3.2 ■ 10^^ eV^, sin^ ^23 = 0.5 and sin^26'i3 
= 0.10 (sohd hne), 0.05 (dotted hne). The upper left and right, and the lower left and 
right panels correspond to neutrino trajectories with Nadir angle On = 0°; 13°; 23°; 30°, 
respectively. 



intervals ~ (3 — 5) GeV and ~ (6 — 8) GeV and clearly seen in Fig. 2, are for On = 0°; 13°, 
due to absolute maxima, i.e., solutions of eq. (p!6D (or (|18|)), which take place at p9 | 



sin2 2^55'^^i = 0.034; 0.039 and El!;^-^^ = 4.4; 4.6 GeV, and at sin^ 2^^'^^^ ^ o.l5; 0.17 and 
Emax2 = 6.6; 7.1 GeV, respectively. One of the most important features of the results 
discussed is p| that the energy of the dominating maxima of the probability P(z/e —>■ u^), 
caused by the mantle-core constructive interference effect, E^~^, lies between the energies 
of the MSW resonance in the core and in the mantle, E^^^ and -E^^, which, e.g., for 
sin^ 2^13 = (0.03 - 0.04) read: E^^^^ = 3.9 GeV and E;^, ^ 9.5 GeV. 

In order to be detected, the medium effects discussed here require a detector with 
a sufficiently good energy resolution. The energies at which the dominating maxima of 
P(z/e v^) occur vary somewhat with the Nadir angle. Thus, the detector has to allow a 
sufficiently precise determination of the direction of the neutrino momentum too. It has 
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Figure 3: The survival probabilities, P{i^^ v^) and P{v^ —>■ v^), in the case of neutrino 
oscillations in the Earth (solid and dashed lines, respectively) and in vacuum (dotted line), 
as functions of the neutrino energy E (in GeV), for Am|^ = 3.2 ■ 10~^ eV^, sin^26'23 = 0.5 
and sin^ 2^13 = 0.10. The upper left, right and the lower left, right panels correspond to 
neutrino trajectories with Nadir angle ft„ = 0°; 13°; 23°; 30°, respectively. 



to be able at least to identify with a rather good efficiency the events which are due to 
Earth core-crossing neutrinos. If these requirements are fulfilled, the matter effects under 
discussion might be measurable. 

Once the Earth mantle-core interference effect has been studied in the sub-dominant 
channel Ve —>■ i^fi, the most interesting implication of this effect is for the survival probability 
P(z/^ —>■ v^). The existence of the absolute maxima in P(t'^j Ve) = P{^e ^n) will lead 
to an appreciable suppression of Piv^ — > v^) if Amg^ > 0, and to no effect in P{v^ — > v^), 
with respect to the vacuum case. In Fig. ^ we show the dependence of the probabilities 
P{^^^, and P(z/^ v^) on E for Am|i = 3.2 ■ 10"^ eV^ sin^ 2^23 = 0.5 and 

sin^ 2^13 = 0.10. The four panels are for Nadir angles 6^ = 0°, 13°, 23° and 30°, respectively. 
The three lines in Figs. ^ correspond to z/^ and oscillations in the Earth (solid and dashed 
lines, respectively) and in vacuum (dotted line). 
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To quantify the mantle-core interference effect in the z/^ or z/^ survival probability, we 
construct the matter-induced CPT-odd asymmetry: 

ACPT — ^7 N , TD(- ^ • \'^'^) 



The CPT-odd probability cancels other I^G] matter effects common for neutrinos and an- 
tineutrinos in the dominant channel v^-. The "theoretical" asymmetry (^) is shown 

in Fig. ^ for the same values of the Nadir angle used in Fig. |^. In all cases, Am|^ = 3.2-10"^ 
eV^, sin^2^23 = 0.5, and sin^ 26^13 = 0.10 (solid lines), and 0.05 (dotted lines). In the most 
relevant energy region between ~ 4 and ~ 9 GeV, the asymmetry is large and with a def- 
inite sign: negative for ^Tn^^ > and positive for Am|^ < 0. There is a change of sign in 
the interval ~ (5 — 6) GeV, whose width depends somewhat on the Nadir angle, but the 
corresponding region is rather narrow and the asymmetry in this region is relatively small, 
except for 6'„ ~ 23°. This again indicates that to measure the effects under discussion a 
sufficient energy and Nadir angle resolution will be required. 

The observable muon charge asymmetry in the muon events produced by the atmo- 
spheric neutrinos is a combination of the CPT-odd asymmetry (involving the survival 
probabilities Pii'^ —* v^) and P{i'^ — v^)) and the CP-odd asymmetry (involving the 
appearance probabilities P{ve '^fi) and P(t'e ^fi))- can define 



A = ' ' ' ' , (24) 



where crcci^fj.) and (Jccij^ii) are the relevant charged current neutrino-nucleon cross sec- 
tions, iV(/i^; E) are the rates of /i~ and /i+ events produced by the atmospheric neutrinos 
with energy E, 



iV(/i-; E) = acc{i^^) [$°(z/^; E) P{v^ ^ v^) + ^°{v,- E) P{v, ^ v^)] 

iV(/i+; E) = acciV^) [^"iV^; E) PiV^ ^ V^) + <I>°(I7,; E) PiV, ^ V ^)] 
and $°(z//;i?) and (^°{j^i]E) are the initial fluxes of the atmospheric z// and 17;, / = e,/x 



(25) 



with energy E. These fluxes are obtained from the code explained in |2 

The charge asymmetry defined by (p^ eliminates the asymmetry due to the difference 
of the cross sections (Tcciy^l) and (Tcc^^i) which at the energies of interest, and to a 
good approximation |^ , both depend linearly on E. Notice that the modulation produced 
by the neutrino fluxes leads to a result which is no longer symmetric with respect to the 
horizontal axis when changing the sign of ^m\i. The net effect, however, is the approximate 
displacement of the symmetry axis in the upward direction. The charge asymmetry ( plf ) 



is plotted in Fig. ^ for the selected Nadir angles On = 0°, 13°, 23° and 30°. The results 
shown in Fig. ^ can be compared with those in Fig. ^ in order to see the effects of the 
contributions due to the Ve ~^ and Vf. —>■ transitions. As is seen in Figs. ^ and ^, the 
main features of the asymmetry Aqpti discussed earlier, are exhibited also by the charge 
asymmetry A. 
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Figure 4: The CPT asymmetry Aqpti eq. p3|), as function of the neutrino energy E 
(in GeV) for lAm^J = 3.2 ■ lO'^ eV^, sin^ 2^23 = 0.5, and sin^ 2^13 = 0.1 (sohd hue), 0.05 
(dotted hne). The sohd (doubly thick sohd) and dotted (doubly thick dotted) lines in 
each panel correspond to Am|^ > (Am|^ < 0). The upper left, right and the lower left, 
right panels correspond to neutrino trajectories with Nadir angle On = 0°; 13°; 23°; 30°, 
respectively. 



To conclude, the propagation of the atmospheric neutrinos through the mantle and the 
core of the Earth leads to new resonance-like effects in the I'eiy^) — > t'fi(t'e) or Vf,{v^) 
^piipe) transitions, depending on the sign of Am\^. This produces observable asymmetries 
between, e.g., the atmospheric and survival probabilities. As it was the case of 
the MSW-resonance in the mixing at constant density and long enough baselines, the 
measurement of the asymmetry between the rates of /i~ and /i"*" events due to atmospheric 
neutrinos (muon charge asymmetry) can allow to determine the sign of Am\i. The muon 
charge asymmetry is rather sensitive to the magnitude of the "connecting" mixing angle 
as well, although the wide energy region around the resonance in the mantle, with stable 
matter asymmetry, disappears once the neutrino path crosses the Earth core. In addition 
to the muon charge discrimination, such measurement requires a sufficiently good neutrino 
momentum resolution, both in magnitude and direction. The implications of these results 
on an actual detector are under study 
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Figure 5: The muon charge asymmetry A, eq. (p^, as function of the neutrino energy 
(GeV) for lAm^^l = 3.2 ■ lO'^ eV^, sin^ 2^23 = 0.5, and sin^ 2^13 = 0.1 (sohd hue), 0.05 
(dotted hne). The sohd (doubly thick sohd) and dotted (doubly thick dotted) lines in 
each panel correspond to Am|^ > (Am|^ < 0). The upper left, right and the lower left, 
right panels correspond to neutrino trajectories with Nadir angle 6'„ = 0°; 13°; 23°; 30°, 
respectively. 
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